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Two types of spatiotemporal chaos exhibited by ensembles of coupled nonlinear oscillators 
are analyzed using independent component analysis (ICA). For diffusively coupled complex 
Ginzburg-Landau oscillators that exhibit smooth amplitude patterns, ICA extracts localized 
one-humped basis vectors that reflect the characteristic hole structures of the system, and for 
nonlocally coupled complex Ginzburg-Landau oscillators with fractal amplitude patterns, ICA 
extracts localized basis vectors with characteristic gap structures. Statistics of the decomposed 
signals also provide insight into the complex dynamics of the spatiotemporal chaos. 
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Spatiotemporal chaos (STC) arising from interaction 
between autonomous elements is ubiquitous in noncqui- 
librium dissipative systems such as fluid flows and chem- 
ical reactions. 1-4 It is generally difficult to reduce the 
complex behavior of strongly coupled systems to the indi- 
vidual dynamics of the component elements, so we must 
employ collective modes of the system for description. 
For example, we employ various types of bases in the 
description of fluids, e.g. Fourier basis, wavelet basis, or 
eigenfunctions of linearized evolution equations, which 
represent flow modes such as waves, vortices, and convec- 
tions. 1-7 In this case, the observer needs to subjectively 
choose which basis to use depending on the situation. 

On the other hand, there also exist methods of 
constructing basis functions objectively from statistical 
properties of the system by some criterion, without ex- 
plicitly fixing them. A representative method is the prin- 
cipal component analysis (PCA) or the Karhunen-Loeve 
expansion, 5-17 which is a standard method in multivari- 
ate analysis. PCA has already been employed in analyz- 
ing STC, for example, to truncate its evolution equation 
or to estimate its degree of freedom. 13-17 However, as 
we show below, when PCA is applied to STC, spatially 
delocalized bases are typically extracted, which are not 
appropriate for describing local field structures. Partic- 
ularly, when the system has translational symmetry, it 
can be proven that PCA extracts the Fourier basis itself. 
Therefore, some statistical method that can objectively 
and compactly capture the complex field structures is 
desirable. 

In this letter, we apply independent component anal- 
ysis (ICA) to STC. ICA is a recently developed method 
of statistical signal processing, which attempts to de- 
compose observed mixed signals into maximally inde- 
pendent signals. 8-12 It is known that the ICA basis 
gives an information-theoretically efficient representation 
of multivariate signals. 8-12 We analyze STC exhibited 
by two types of coupled nonlinear oscillators, namely, 
locally (diffusively) coupled complex Ginzburg-Landau 
oscillators (LCGL), 1-4 and nonlocally coupled complex 
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Ginzburg-Landau oscillators (NCGL), 18 22 and assess 
the utility of ICA in analyzing such STC. 




Fig. 1. (a) Snapshot and (b) evolution of the amplitude patterns 
exhibited by LCGL. (c) Snapshot and (d) evolution of the am- 
plitude patterns exhibited by NCGL. 



We consider spatially one-dimensional systems of unit 
length on [0,1]. The LCGL is a system of diffusively cou- 
pled CGL oscillators, which obeys 

d 2 W 

(l + iC2 )\W\ 2 W + D(l + i c 1 )^ r , (1) 



dW{x,t) 



W- 



dt dx 2 
where x represents the position, t the time, and W the 
complex amplitude of the CGL oscillator. This is a uni- 
versal equation derived from general evolution equations 
for self-oscillatory media by the center-manifold reduc- 
tion near the supercritical Hopf bifurcation point. 
Here, c-i represents the angular velocity of a single oscil- 
lator, c\ the phase shift of diffusive coupling, and D the 
diffusion coefficient. We fix these parameters at C\ = 1.0, 
c 2 = —1.5, and D = 5 x 10 -5 . We assume Neumann 
boundary conditions dW/dx\ x= o — dW / dx\ x= \ — 0, so 
that the system is not translationally symmetric. When 
c\ and C2 satisfy the Benjamin- Feir condition 1 + c\C2 < 
0, the system exhibits STC. Figure 1(a) shows a typical 
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snapshot of the amplitude pattern |W(x, t)\ and Fig. 1(b) 
its temporal evolution. In this parameter region, the am- 
plitude pattern is composed of characteristic hole struc- 
tures that move around the system randomly (defect tur- 
bulence 1 - 4 ' 23 - 26 ). 

On the other hand, the NCGL is a system of CGL oscil- 
lators coupled through a nonlocal mean field weighted by 
a kernel that decreases exponentially with distance. 18-22 
It obeys 

dW ^ = W -{l + ic 2 )\W\ 2 W + K(l + i Cl ) 

X {l/ e~ lW ~ xt[ W{x',t)dx' - wj ,(2) 

where ci represents the angular velocity, c\ the phase 
shift of nonlocal coupling, K the coupling strength, and 
7 -1 the coupling distance. We fix the parameters at 
ci = -2.0, c 2 = 2.0, 7 -1 = 0.125, and K = 0.85. We do 
not assume periodic boundary conditions, and restrict 
the integration interval to [0, 1] (though the kernel is 
formally normalized in the infinite domain). When the 
Benjamin-Feir condition 1 + C1C2 < holds, this system 
also exhibits STC. However, this STC is considerably 
different from that of the LCGL. Figure 1(c) shows a 
typical snapshot of the amplitude pattern |W(x, t)\ and 
Fig. 1(d) its temporal evolution. The amplitude pattern 
is not continuous but consists of relatively coherent re- 
gions and disordered regions with discontinuous gaps. Its 
power spectrum I(q) exhibits a power-law dependence on 
the wave number q as shown in Fig. 5. 18-22 In this param- 
eter region, such a fractal disordered amplitude pattern 
evolves steadily. 

We focus on the amplitude pattern |W(a:,i)| of these 
two systems hereafter. We discretize a certain domain of 
space into n segments of length Ax and define Ui(t) = 
\W(iAx,t)\. The amplitude pattern is now represented 
by an n-dimensional vector u(t) = (ui (£),-•• ,u n (t)) T , 
and its temporal sequence is observed. We consider the 
observed signal and its transformations (denoted by 
lower-case letters, e.g., u(t) or z(t)), to be the real- 
izations of the underlying stochastic variables (denoted 
by capital letters, e.g., U or Z). In the following, we 
subtract the mean value E[XJ] from u(t) and regard 
z(t) = (zi(t), • • • , z n (t)) T = u(t) — E[XJ] as the observed 
signal. Here, £?[•••] denotes the expectation, which is 
substituted by the long-time average of the observed sig- 
nal in actual numerical calculations. We decompose z(t) 
using an n-dimensional basis {a^ } (j = 1 • • • n) as 

n 

*(t) = J2 s j( t >3' ( 3 ) 

where s(t) — (s\(t),--- ,s n (t)) T represents the decom- 
posed signals. If we use the sinusoidal basis here, this 
gives a Fourier decomposition. In the following, we use 
PCA and ICA bases. 

PC A extracts orthogonal basis vectors {a^} on which 
the stochastic variable Z distributed in the n-dimensional 
space has the maximum projection (principal compo- 
nents) in order of importance. PCA is achieved by choos- 
ing the eigenvectors of the covariance matrix £ of Z as 



the basis. 5 12 Namely, each {aj} satisfies an eigenequa- 
tion Saj = Aj-a,-, where S = E[ZZ T ] = (E[ZiZj]). Since 
S is a real symmetric matrix, Aj > for all j. Each 
Xj represents the relative ratio of the j-th component 
a.j contained in the observed data. The coefficients Sj(i) 
and Sj(t) are uncorrelated when i =/= j, but generally not 
independent. 

On the other hand, ICA attempts to extract mutually 
independent signals s(t) from the observed signals z(t), 
which are assumed to be a linear mixture of s(t) by some 
unknown constant n x n matrix A, i.e., z(t) = As(t). We 
assume s[t) to be the outcomes of a stochastic variable S, 
whose components are mutually independent. It is known 
that 8-12 if the number of Gaussian-distributed compo- 
nents of S is at most one (which we assume hereafter), a 
decomposing matrix W exists such that the decomposed 
signal y(t) = (yi(t), • • • , y n {t)) T = Wz(i) coincides with 
s(t), except for inevitable ambiguities in the scale and 
order of the components. To find such a decomposing 
matrix W, we minimize the mutual information I(Y) be- 
tween the probability density function (PDF) P(y) of the 
stochastic variable Y = (Y\, ■ ■ ■ ,Y n ) T and its marginal- 
ized PDFs Pi(yi) = J P(y)dyi ■ ■ ■ dy l - 1 dy l+1 ■ ■ ■ dy n , 

so that the decomposed signals become maximally in- 
dependent. The matrix W that minimizes I(Y) can be 
obtained using Amari's natural gradient method 8-12 as 

W ■ W ,yMXlw T W = W + n (l - E[ l p(Y)Y T ]j w, 

(5) 

where 77 is a learning rate, and y(Y) = 
((fi(Yi), • • • , ip n {Y n )) T is a nonlinear vector function of 
Y. By formally differentiating eq. (4), each component 
of <p(Y) is calculated as <Pi(Yi) = — d log Pi (Yi)/dYi, 
which necessitates knowledge of the unknown functions 
PiiYi). However, it is known that 8-12 the signals can be 
decomposed by assuming simple functional forms for 
fi(Yi) instead of using the true PDF of Y i: and various 
algorithms have been devised. In the following, we use 
the well-known extended infomax algorithm 8-12 given 

by 

<Pi(Yi) = h tanh(Yi) + Yi, 

h = sign {E[l - tanh 2 (y i )]£ ; K 2 ] - S[tanh(Y i )Y i ]} , (6) 

where fc, takes either +1 or —1 depending on the sign 
of the expression inside the curly brackets. From the es- 
timated decomposing matrix W, ICA basis vectors are 
obtained as (ai, • • • ,a n ) = W _1 . When i ^ j, the coef- 
ficients Si(t) and Sj(t) are mutually independent, but a^ 
and a.j are generally not orthogonal. 

In actual numerical calculations, the LCGL and NCGL 
are numerically simulated using N = 2 10 — 2 11 spatial 
grid points. We discretize the central part of the system 
0.375 < x < 0.625 using n = 128 points (Ax = 1/512) 
and observe the amplitude pattern every second for 
20000 seconds. The decomposing matrix W is initially 
set to an identity matrix and updated 5000—10000 times 
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using a learning rate rj between 0.05 — 0.3. Due to the 
ambiguity of ICA, the extracted vectors depend on the 
observed data and on the initial condition for W, even 
if the parameters of the systems are the same. Also, we 
can generally find only local minima in this type of high- 
dimensional (here 128 2 -dimensional) optimization prob- 
lem. However, in our numerical calculations, we always 
obtained qualitatively the same results for various data 
sets, including those obtained using cyclic boundary con- 
ditions. 



large negative value. Figure 3(b) shows PDFs P(|s|) of 
the absolute value \s\ averaged over all signals in loga- 
rithmic scales for s > and s < 0. Both distributions are 
super-Gaussian with much heavier tails than the normal 
distribution. Reflecting the concave asymmetric shape of 
the vector, P(|s|) for positive s and negative s are differ- 
ent. The tail part of P(|s|) exhibits power-law behavior, 
implying the existence of some self-similarity in the for- 
mation of holes. 
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Fig. 2. (a) PCA basis vectors No. 1, 10, and 100. (b) ICA basis 
vectors No. 30 and 90. (c) Magnification of ICA basis No. 90. 
The dotted line is a fit using the function 1/ cosh[a(a; — 6)], where 
the parameters are estimated to be a = 141 and b = 0.551. (d) 
All ICA basis vectors. The graph is plotted stereoscopically by 
gradually shifting the baseline of each basis. 



Fig. 3. (a) Temporal sequence of the coefficient s of the ICA basis 
vector No. 90. (b) PDFs P(|s|) of absolute coefficient \s\ for s > 
and s < 0. (c) PDF P(l) of interval I between two successive 
generation of holes (short time-scale region). The inset shows 
P(l) at a larger scale, (d) Correlation C(Aj, At) between two 
decomposed signals. 



Let us analyze the LCGL first. Figure 2(a) shows 
three typical basis vectors among 128 vectors obtained 
by PCA. These vectors, as well as the other vectors not 
displayed here, are all roughly sinusoidal and spatially 
delocalized. Thus, the PCA basis does not capture the 
local hole structures of the LCGL very well. Figure 2(b) 
shows two typical basis vectors among 128 vectors ob- 
tained by ICA. Reflecting the characteristic hole struc- 
tures of the system, spatially localized one-humped vec- 
tors are extracted. Each vector can be fitted well by a 
function given by 1/ cosh[a(x — b)], as shown in Fig. 2(c). 
There is no a priori reason for it to satisfy the LCGL as 
a special solution, 23-26 but its width is roughly the same 
as that of the actual hole structures and scales properly 
with the diffusion constant D. All other basis vectors 
have almost the same shape, but their locations differ 
from each other, so that the entire observed domain is 
completely covered, as shown in Fig. 2(d). Here, the ob- 
tained basis vectors are sequentially aligned because we 
used an identity matrix as the initial W. If we use a 
random matrix as the initial W, we obtain similar basis 
vectors but their order and vertical orientation become 
random. 

Let us turn our attention to the ICA expansion coeffi- 
cients (decomposed signals). Since the ICA basis reflects 
localized hole structures, when the coefficient Sj of some 
basis vector &j takes a large negative value, we can judge 
that there exists a hole at position j. The temporal evo- 
lution of a coefficient s corresponding to a typical ICA 
basis vector (No. 90) is shown in Fig. 3(a). Correspond- 
ing to the appearance of holes, s occasionally takes a 



To characterize the temporal structure of s, we inves- 
tigate the PDF of time interval I between two successive 
events at which s becomes smaller than some negative 
threshold h. It represents the time interval between two 
holes, where h determines how large an event must be 
to be counted as a hole. Figure 3(c) displays the PDF 
P(l) of / for ft, = —3 averaged over all signals. The PDF 
dips considerably when < I < 20 (shown by an arrow) , 
which indicates the existence of refractory periods. After 
the disappearance of the first hole, the next hole is less 
likely to appear at the same position for awhile. The PDF 
decreases exponentially at large values of I as shown in 
the inset, indicating a Poissonian random appearance of 
holes at large time scales. 

Figure 3(d) shows correlation functions C(Aj, At) = 
E[sj(t)sj + Aj(t + At)] between two signals Sj and Sj+Aj 
whose index numbers are separated by Aj for several 
values of the temporal difference At. The curves are av- 
eraged over j and t, and smoothed by averaging over 
5 neighboring data points on both sides. Since the vec- 
tors are spatially aligned sequentially, Aj corresponds to 
a spatial distance between two basis vectors. The cor- 
relation gradually spreads from neighboring vectors to 
distant vectors, which clearly captures the dynamics and 
decoherence of hole structures. Note that the ICA algo- 
rithm used here does not take into account the temporal 
structure of the signals, hence the decomposed signals 
can be correlated when At ^ 0. 

Let us now analyze the NCGL. Examples of PCA basis 
vectors are shown in Fig. 4(a). All PCA vectors are delo- 
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Fig. 4. (a) PCA basis vectors No. 1, 10, and 100. (b) ICA basis 
vectors No. 40, 80, and 111. (c) Magnification of ICA basis vec- 
tor No. 63. (d) All ICA basis vectors, drawn stereoscopically by 
shifting the baselines. A few long-wavelength vectors are omit- 
ted. 



calized and sinusoidal in this case again. Figures 4(b) and 
4(c) show ICA basis vectors. As shown in Fig. 4(c), most 
vectors typically have a localized structure with a gap 
and two tails, reflecting the gaps of the amplitude pat- 
tern of the NCGL. We also found a few (at most 5 percent 
of the total number) long-wavelength delocalized vectors 
such as No. Ill shown in Fig. 4(b). In the following anal- 
ysis, we omit such exceptional vectors. The location of 
each vector is different, and the entire observed domain 
is covered, as shown in Fig. 4(d). These ICA basis vectors 
not only reflect the gap structures of the NCGL but also 
reflect its singularity. As shown in Fig. 5, the power spec- 
trum of the ICA basis vector exhibits a power law similar 
to that of the original amplitude pattern. Although the 
statistics are poor, the power-law behavior can readily 
be seen for a single basis. The average spectrum over all 
vectors agrees well with the spectrum of the original am- 
plitude pattern. In these respects, the ICA basis captures 
the given spatial patterns more faithfully than the PCA 
basis, which does not possess such properties. 



also expected to exhibit noisy on-off intermittency. Fig- 
ure 6(a) shows the temporal evolution of a typical ICA 
coefficient s (No. 63). Large gap structures are generated 
intermittently. The PDF P(|s|) of the absolute coefficient 
|s| averaged over all signals is shown in Fig. 6(b). In this 
case, P(|s|) for both s > and s < is symmetric, 
since the shape of each basis vector is statistically sym- 
metric. The PDF is super- Gaussian with a flat region 
for small |s|, a power-law region for medium |s|, and a 
sharp cutoff due to nonlinearity at large |s|. This shape is 
characteristic of the noisy on-off intermittency. 18-22 Fig- 
ure 6(c) shows the PDF of the laminar length interval 
I during which s is smaller than some threshold h (here 
h = 1.5). It represents the duration between two suc- 
cessive appearances of gap structures. It is known that 
the laminar length PDF of noisy on-off intermittency is 
determined by the first passage time PDF of a Wiener 
process, which has a power-law region Z -3 / 2 and an expo- 
nential cutoff. 27,28 This is confirmed in Fig. 6(c) for the 
ICA coefficient. Finally, Fig. 6(d) shows the correlation 
C(Aj, At) between signals for several values of At. The 
correlation does not spread at all in this case, indicating 
that the ICA basis vectors persist to be independent of 
each other for a long duration. 
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Fig. 5. Power spectra of the original amplitude pattern and the 
ICA basis vectors of the NCGL. Circles(o) represent the spec- 
trum of a single ICA basis vector, crosses(+) the averaged spec- 
trum over all ICA basis vectors, and the solid line the spectrum 
directly calculated from the amplitude pattern. The broken line 
is the power-law function q~ . Each curve is vertically shifted 
arbitrarily for comparison. 

Since each ICA basis vector has a gap structure, its 
coefficient quantifies a gap in the amplitude pattern. It 
was shown in previous studies 18-22 that the difference in 
amplitude between two nearby oscillators exhibits noisy 
on-off intermittency. 27, 28 Thus, the ICA coefficient is 



Fig. 6. (a) Time sequence of the coefficient s of the ICA basis vec- 
tor No. 63. (b) PDFs P(\s\) of the coefficient |s|. (c) PDFs P(l) 
of the laminar length I. The straight line is a power-law l~ 3 / 2 . 
(d) Correlation C(Aj, At) between two decomposed signals. 

Summarizing, we applied ICA to STC in two types of 
coupled oscillators and extracted localized basis vectors 
that accurately represent the local structures of those 
systems, which demonstrates the utility of ICA in ana- 
lyzing the complex spatiotemporal dynamics of nonequi- 
librium dissipative systems. For the LCGL, ICA extracts 
a hole structure as a characteristic feature, while for the 
NCGL, ICA extracts a gap structure with two tails as a 
characteristic feature. Although there exists no general 
analytic relationship, the ICA bases obtained in this let- 
ter are similar to the wavelet bases 7,22 in the sense that 
the basis vectors are localized both in space and in fre- 
quency, and cover the entire space by spatial translation. 
However, these ICA basis vectors do not form a hierarchy 
over scales through dilatation, which is characteristic of 
the wavelet basis vectors. The fractality of the amplitude 
pattern in the NCGL is embodied in the singularity of 
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each basis vector, as shown in Fig. 5. In this letter, we 
dropped the phase information of the oscillators for sim- 
plicity, but the phase also contains important informa- 
tion. In order to capture the phase information, complex 
ICA of STC, which is conceptually more difficult, is now 
under investigation. 
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